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ABSTRACT 

An  algorithm  is  described  for  determining  the  optimal  solution  of 
parametric  linear  and  quadratic  programming  problems  as  an  explicit  piece- 
wise  linear  function  of  the  parameter.  Each  linear  function  is  uniquely 
determined  by  an  appropriate  subset  of  active  constraints.  For  every  crit¬ 
ical  value  of  the  parameter  a  new  subset  has  to  be  determined.  A  simple 
rule  is  given  for  adding  and  deleting  constraints  from  this  subset. 
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SIGNIFICANCE  AND  EXPLANATION 


In  many  applications  of  linear  and  quadratic  programming  it  is 
necessary  to  obtain  an  optimal  solution  for  more  than  one  set  of  input 
data.  In  particular,  if  the  right  hand  sides  of  the  constraints  Ax  <  b 
can  be  interpreted  as  capacities,  it  might  be  useful  to  study  the  behavior 
of  the  optimal  solution  if  b  is  replaced  by  c  +  tp  ,  where  t  is  a 
parameter  which  varies  in  some  interval!,  say  [t  ,  t]  .  Similarly,  if  the 

coefficients  of  the  objective  function  c'x  are  prices,  it  is  sometimes 
desired  to  compute  the  optimal  solution  for  all  objective  functions  of  the 
form  (c  +  t  q) '  x  for  t  £  [_t  ,  t]  . 

Parametric  problems  of  this  type  have  the  following  basic  property. 

There  are  critical  values  t  =  t.  <  t,  <  . . .  <  t  =  t  such  that  the 

—  o  l  v 

optimal  solution  is  a  linear  function  of  t  for  tj  <  t  <  t-+^  .  This 
linear  function  can  be  computed  from  a  linear  system  of  equations  which 
is  determined  by  a  certain  set  of  active  constraints.  For  each  critical 
value  of  t  this  set  of  active  constraints  changes. 

It  can  happen  that  for  some  critical  values  of  t  the  new  set  of 
active  constraints  differs  from  the  previous  one  by  several  constraints. 

In  this  case  determination  of  the  correct  set  can  be  tedious.  This  diffi¬ 
culty  can  be  overcome  by  a  simnle  selection  rule  which  results  in  a  finite 
number  of  intermediate  sets  which  differ  from  each  other  by  exactly  one 
constraint.  Therefore,  che  problem  reduces  to  the  simple  case  of  con¬ 
secutive  sets  of  active  constraints  which  are  obtained  from  each  other  by 


The  responsibility  for  the  wording  and  views  expressed  in  this  descripti\ 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


ON  PARAMETRIC  LINEAR  AND  QUADRATIC 
PROGRAMMING  PROBLEMS 


Klaus  Ritter 


1.  Introduction 


In  practice  it  is  often  important  to  study  the  behaviour  of  the  opti¬ 
mal  solution  of  a  linear  or  nonlinear  programming  problem  if  some  of  the 
data  change.  In  this  paper  we  consider  linear  und  convex  quadratic  minimiza¬ 
tion  problems  with  the  property  that  the  right  hand  side  of  the  constraints 
and/or  the  linear  part  of  the  objective  function  depend  linearly  on  a  para¬ 
meter  t  which  varies  in  a  certain  interval  1.  It  is  known  [3]  that  in  these 
cases  the  optimal  solution  is  a  piecewise  linear  function  of  the  parameter. 
There  is  a  finite  number  of  critical  values  of  the  parameter  for  which  the 
representation  of  the  optimal  solution  as  a  function  of  t  changes.  These 
critical  values  are  characterized  by  the  fact  that  the  set  of  constraints, 
active  at  the  optimal  solution  changes.  In  a  reaular  case  when  exactly  one 
active  constraint  becomes  inactive  or  exactly  one  inactive  constraint  be¬ 
comes  active  it  is  not  difficult  to  find  the  new  representation  of  the 
optimal  solution  as  a  function  of  t  .  However,  in  a  degenerate  situation 
where  for  a  critical  value  tj  of  the  parameter  several  constraints  be¬ 
come  newly  active  and/or  several  multipliers  become  zero,  it  may  be  tedious 
to  find  the  correct  set  of  constraints  which  determine  the  optimal  solution 
for  t  >  t .  . 

It  is  the  puroose  of  this  paper  to  describe  a  method  which  can  be  used 
to  overcome  these  difficulties.  For  every  value  of  the  parameter  for  which 
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the  given  problem  has  an  optimal  solution,  the  Kuhn-Tucker-condi tions 
(see  e.g.  [21)  and  an  appropriately  chosen  set  of  constraints  can  be  used 
to  determine  the  optimal  as  a  function  of  the  parameter  by  solving  a  linear 
system  of  equations.  For  a  regular  critical  value  of  t  the  selected  set 
of  constraints  is  changed  in  one  of  the  following  ways.  Either  a  constraint 
is  added  to  the  set  or  a  constraint  is  deleted  from  the  set  or  both.  In  a 
degenerate  case  it  could  be  necessary  to  repeat  this  procedure  several  times 
before  the  correct  set  of  constraints  is  obtained.  In  order  to  avoid  cycling 
the  selection  of  the  constraint  that  enters  or  leaves  the  considered  set 
has  to  be  made  with  some  caution.  It  is  shown  that  cycling  does  not  occur 
if  the  following  rules  are  used.  First,  adding  a  constraint  to  the  selected 
set  has  priority  over  deleting  a  constraint  from  the  set.  Second,  if  there 
are  several  candidates  for  entering  or  leaving  the  set  in  each  case  the 
one  with  the  smallest  index  will  be  chosen.  The  advantage  of  this  method 
is  that  regular  and  degenerated  critical  values  of  t  are  treated  in  the 
same  way.  The  only  difference  is  that  in  the  degenerate  case  more  than  one 
change  of  the  selected  set  of  constraints  could  be  necessary. 

In  the  following  section  we  give  a  precise  statement  of  the  problem 
and  establish  some  preliminary  results.  In  Section  3  basic  nroperties  of 
parametric  quadratic  programming  problems  and  their  relation  to  the  proposed 
method  are  given.  In  the  final  section  an  aloorithm  is  described  for  compu¬ 
ting  the  ootimal  solution  as  an  explicit  function  of  the  parameter.  It  is 
shown  that  it  terminates  after  a  finite  number  of  iterations. 


Formulation  of  the  problem  and  preliminary  results 


Let  c  ,  q  ,  and  x  be  n-dimensional  column  vectors  and  let  A  and 

b  with 

A-  =  (a1,...,am)  ,  b'  =  ((b)1,...,(b)m) 

bo  an  (m,n) -matrix  and  an  m-dimensional  column  vector,  resnecti .ely.  Further¬ 
more,  assume  that  C  is  a  symmetric  positive  semi -def ini te  (n,n)-natrix.  We 
consider  the  problem  of  determining  the  optimal  solution  to 
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(2.1) 


min  |  (c  +  tq) '  x  +  x'Cx  j  Ax  <  b  +  tD 

as  an  explicit  function  of  the  parameter  t  for  all  values  of  t  with 

t  s  t  s  t  . 

If  C  =  0  ,  then  the  parametric  quadratic  programming  problem  (2.1)  reduces 
to  a  parametric  linear  programming  problem. 

Because  C  is  assumed  to  be  positive  semi  definite  it  follows  from  the 
Kuhn-Tucker-Theorem  (see  e.g.  [21),  that  x  is  an  optimal  solution  to  (2.1) 
if  and  only  if  there  is  a  vector  u  €  Em  such  that 

Cx  +  A'u  =  -  (  c  +  tq  ) 

Ax  <  b  +  t  p  (2.2) 

u'(Ax-b-tp)  =  0,  u  >  0  . 

Troughout  this  paper  we  assume  that 

rank  (C,  A' )  «  n  .  (2.3) 

The  purpose  of  this  assumption  is  to  guarantee  that  if  (2.1)  has  an  optimal 
solution  for  some  t  it  also  has  an  optimal  solution,  x  say,  which  is  the 
unique  optimal  solution  in  the  intersection  of  the  constraints  that  are  active 
at  x  .  This  fact  is  established  in  the  following  lemma. 

Lemma  1 

If  rank  ( C ,  A 1  )  =  n  and  (2.1)  has  an  optimal  solution  for  some  t  , 
then  there  is  a  set  I  c  ;l,2,...,m}  and  an  optimal  solution  x  of 
(2.1)  such  that 

i)  The  vectors  a-,  i  €  I,  are  linearly  independent 
ii)  x  is  the  unique  optimal  solution  to  the  problem 

min  |  (c  +  tq)'  x+^x'Cx  !  al  x  =  (b)i  +  t(p)i  ,  i  €  I  \  . 

Proof: 

For  t  =  t  let  xQ  =  x  (t)  be  any  optimal  solution  to  (2.1).  Define  the  set 
IQ  <r  {l,2,...,m;  such  tbit  ’  f  I  if  and  only  if 
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ai  xo  =  (b)i  +  t(p)i  • 

If  xQ  is  the  unique  optimal  solution  to  the  problem 

min  |  (c  +  tq)'x  +  ■£  x'Cx  |  at  x  =  (b) .  +  t(p)^  ,  i  €  IQ  )  (2.4) 

it  suffices  to  set  x  =  xQ  and  to  choose  any  maxinal  subset  I  c  IQ  such 
that  the  vectors  a^  ,  i  €  I  ,  are  linearly  independent. 

Now  suppose  that  xQ  *  xQ  is  an  optimal  solution  to  (2.1).  Set 
s  =  xo  -  x0  and 

Q(x  :t)  =  (c+  tq)'x  +  \  x‘C  x  . 

A 

Then  it  follows  from  the  convexity  of  Q(x;  t)  that 

Q(xq  +  cr  s;  t)  =  9(x0  ;  t)  for  all  :  .  (2.5) 

This  implies  that  s'Cs  =  0  and,  because  C  is  positive-semi  definite, 

Cs  =  0.  Therefore,  it  follows  from  (2.3)  and  the  relations 

a-  s  =  0  ,  i  e  IQ  (2.6) 

that  there  is  i  ,  i  €  lQ  ,  such  that  a‘-  s  *  0  .  Hence  we  deduce  from 

(2.5)  and  (2.6)  that,  for  some  aQ  , 

*1  =  *o  +  ao 5 

is  an  optimal  solution  to  (2.1)  with 

a-  Xj  =  (b)i  +  t(p)i  ,  i  €  Ij  , 

where  I  c  Ij  and  IQ  *  Ij  .  Repeatino  this  argument  if  necessary  we 
obtain  an  optimal  solution  x^  to  (2.1)  and  a  set  I,  c  {l,2,...,m}  such 
that  x  is  the  only  optimal  solution  to  (2.1)  which  satisfies  the  equations 

a-  x  =  (b)i  +  t(p).  ,  i  e  I.  .  (2.7) 

Setting  x  =  x  and  choosing  any  maximal  subset  I  <r  I  ,  such  that  the 

vectors  a.  ,  i  6  I  ,  are  linearly  independent  completes  the  proof  of  the 

1 emma . 
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In  the  following  sections  we  will  associate  with  each  t  €  [  t  ,  t] 

/*V 

for  which  (2.1)  has  an  optimal  solution  a  matrix  A  and  an  optimal  solution 
x  with  the  properties  specified  in  the  above  lemma.  Let 

a(,  x  <  (b)v  +  t(p)v  (2.8) 

be  any  constraint  which  for  t  =  t  is  active  at  the  optimal  solution  x  . 
Then  this  constraint  is  said  to  be  a  primary  active  constraint  if  a,,  is  a 
column  of  A'.  If  a^  is  not  a  column  of  A'  ,  then  (2.4)  is  referred  to 
as  a  secondary  active  constraint. 

For  later  reference  we  prove  the  following  lemma. 

Lemma  2 

The  matrix 

Pi 

is  nonsingular  if  and 
i)  The  columns  of 

ii)  x'Cx  >  0  for  every  x  *  0  with  A  x  =  0  . 


only  if  the  following  conditions  are  satisfied 

/*. 

A'  are  linearly  independent. 


Proof: 

First  assume  that  the  conditions  of  the  lemma  are  satisfied.  Let  (x,y)  be 
any  solution  of  the  equations 

C  x  +  A'  y  =  0 

(2.5) 

Ax  =  0  . 

Then  x’Cx  =  -  y’Ax  =  0  implies  x  =  0  .  Thus  A'y  =  0  and,  therefore, 
y  =  0  .  This  shows  that  M  is  nonsingular. 

If  the  columns  of  A'  are  linearly  dependent  it  follows  immediately 
that  M  is  singular.  Finally,  if  there  is  x  *  0  with  x'Cx  =0  and 
Ax  =  0  ,  then  Cx  =  0  and  (x,  0)  is  a  solution  of  the  equations.  Hence, 
M  is  sinoular. 


-  i; 


3.  Basic  properties  of  parametric  quadratic  and  linear  programming  problems 

For  t  =  t-  let  x.  =  x^(t)  be  an  optimal  solution  to  (2.1)  for  which 
assumption  (2.3)  is  satisfied.  Re-numbering  constraints  if  necessary  and 
using  Lemma  1  we  can  assume  that 

a^  Xj  =  (b)i  +  t j ( p ) ^  ,  i  =  1 , . . . , p 

a}  Xj  <  (b).  +  tj(p)i  ,  i=o+l» . . • »m 

and  x-  is  the  unique  optimal  solution  to 

J 

min  |  (c  +  tjqVx+^-x'Cx  |  A  j  x  =  b ..  +  ^  j  P  j  }  * 
where,  for  some  v  <  o  , 


(«!• 


,a  ) 
v' 


=  ((b)r 


’(b)v> 


p\  =  ((P)1»--*»(P)V) 


and  the  columns  of  A1,  are  linearly  independent. 

vJ 

Let  u-  =  u-(t,)  >0  be  such  that 
J  J  J 

C  Xj(tj)  +  A'  Uj(t-)  =  -  (c  +  tj  q) 

with  {u-)-  =  0  for  i=v+l,...,m  .  Then  the  optimality  conditions  (2.2)  can 
be  written  in  the  form 


CXj(t)  +  =  -  (c  +  tq)  (31) 

AjXj(t)  =  bj  +  tpj  • 

aiXj(t)  <  (b)i  +  t(p)i  ,  i  =v+ 1 , . . . , m  (3.2) 

v.(t)  >  0  ,  (3-3) 

h  p  f  f) 

Vj(t)  €  EJ  and  (v^(t)).  =  (uj(t))i  ,  i=l,. 
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V  . 


Since  by  Lemma  2, 

/C  ,  a; 

M.  =  J 

J  An 
\ A  j  ’  u 

is  nonsingular,  the  inverse  matrix 

HU  •  M2j  \ 

M3j  •  %  j 

exists. 


Setting 

hlj  ■  -  VCttjq)  +  WW  1  h2J  = 

’U  ’  -  +  WVj>  •  820  = 

we  obtain  from  (3.1)  the  relations 

Xj<l>  '  -  Mjjfcttd)  +  Hylbj  +  tpj) 

-  hy  *  (t-tj)  hy 
and 


-  Mjjq  +  MyPj 

-  Mj.q  + 


(3.4) 


*j(t)  -  -  H3j(c*tq)  *  M4j.  ( b  j  +  t  Pj  )  (3.5) 

■  «lj  +  (‘-‘j’  "jj  ■ 

Substituting  x.(t)  into  (3.2)  we  have,  for  i=v+l,...,m  ,  the  inequality 

vj 

ai  hlj  +  (t-tj)  ai  h2j  -  (b>i  +  Vp)i  +  (3-6) 

or 

(t  ■  t j ) ( a t  h2j'(p)i)  <  (b)i  +  tj(p).  -  a;,  hjj  . 

Therefore,  x.(t)  is  a  feasible  solution  for  all  t  >  0  for  which  these 
inequalities  are  satisfied. 


Because  -  Xj(ts)  ,  it  foll^./s  from  (3.2)  that 
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(b).  +  tj(p).  -  ai  h2j.  >  0  ,  i=v+l, . . .  ,m 


(3.7) 


If  (ai  h2j  “  ( P ) i )  -  0  *  i=v+l»- • • »m  .  set  tj+1  =  «  ,  otherwise  set 


t*  ,  -  t.  =  min  {  (b)i  +  tj(P)i  --alhii  |  a;.  h2j  -  (p)f  >  0  }  (3.8) 

J+1  J  1  a}  h2i  -  (p)i  1  43  J 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 


Because  of  (3.7)  we  have  t*+1  >  t.  .  Define  the  set  1^  of  critical 
indices  as  follows 


!lj  s  j1’  |(b^i  +tj(p)i  "ai'hlj  =  0  and  ai  h2j  '  (p)i  >  0  j  ’ 

Clearly,  t*+1  >  t^  if  and  only  if  1^  =  0. 

If  1^  *  0  ,  then  Xj(t)  ,  as  defined  by  (3.4),  is  not  feasible  for 
any  t  >  t.  .  Thus  at  least  one  of  the  secondary  active  constraints  must  be¬ 
come  a  primary  active  constraint.  We  choose  the  constraint  with  index 


k  =  min 


1n  { 1 1 1 


(3.9) 


The  computation  of  the  new  matrix  Mj+1  is  discussed  below. 

Suppose  now  that  1^  =  0  and  observe  that  by  (3.3)  we  have 

vj<V  ■  <3-I0) 

If  g?.  >  0  ,  then  v.(t)  >  0  for  all  t  >  t,  .  In  this  case  we  set 
tj^i  —  CO  *  otherwise  set 

t.  ,  *  t.  =  min  j  - -iii  (g?i)i  <  0  )  (3.11) 

3 1  J  HVi  ,J 

and  let  1  be  the  smallest  index  for  which  the  minimum  is  attained.  Because  of 
(3.10),  tj+1  >  t.  .  With 

Uj  =  {  1  |  (gx j ) i  =  o  and  (q2j)i  <  o  } 
it  follows  immediately  that  tj  +  ^  >  t  ^  if  and  only  if  T -> j  =  0  . 
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If  1 2 j  *  0  ,  then  Xj(t)  is  not  optimal  for  any  t  >  tj  .  Thus  at 
least  one  of  the  primary  active  constraints  must  become  a  secondary  active 
constraint.  We  choose  the  constraint  with  index 


1  =  min  {  i  j  i  €  I?. 


1 

2j  ! 


(2.1?.) 


The  new  matrix  is  derived  below. 


Set  I9j  =  0  .  In  order  for  x^(t)  to  be  an  optimal  solution  (2.1), 
both  the  inequalities  (3.6)  and  (3.5)  have  to  be  satisfied.  Thus  we  set 


tj+i  =  min 


( 


[  lj  +  l  5  lj  +  l  f  • 


Then  the  following  lemma  holds. 


Lemma  3 


There  is  tj  +  1  >  tj  such  that 


Xj(t)  =  h^j  +  ( t -  t  j )  hg j  is  an  optimal  solution  to  (2.1) 


for  all  t  with  t.  <  t  <  t.+j  . 


ii)  There  is  no  t  >  tj+j  such  that  x.(t)  is  an  ootimal  so¬ 
lution  to  (2.1)  for  t  =  t  . 


iii)  tj+1  >  t.  if  and  only  if  1^  U  =  2  . 

We  now  discuss  the  computation  of  the  new  matrix  M.+j  . 

Case  1: 

Either  Ijj  *  0  or  1^  =  I?^  =  0  and  t^  =  t*  +  ]  .  In  either  case 
the  constraint 

^  X  5  (b)k  +  t(b)k  (3.13) 

has  to  be  added  to  the  set  of  primary  active  constraints.  ~hare  are  two  cases 
depending  on  whether  is  an  element  of  span  {  a^, .  . .  ,a_  "•  or  not.  In 
order  to  decide  which  case  applies  we  consider  the  equations 
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from  which  vie  obtain 


Cw  +  Aj  ?■  =  ak 
Ai  w  =  0  , 

w  =  M1jak  ,  z  =  M3ak  . 
Clearly,  ak  €  span  {  a^, . . . ,a  }  if  and  only  if  w  =  0  . 


(3.14) 


First  assume  that  ak  $  span  {  a^ . . ,av  }  .  In  this  case  we  set 

Aj+1  =  (Aj  ’  ak^ 


and 


Vi 


1  c  ■  *j*i 

\Aj+l  ’  0 


Since  the  columns  of  Ai+^  are  linearly  independent  it  follows  from  Lemma  2 
that  is  nonsingular. 


Next  assume  that  w  =  0  .  Since  in  this  case  the  vectors  aj . 

are  linearly  dependent  we  have  to  determine  a  constraint 


a^  x  <  (b)1  +  t(p)1 


in  the  set  of  primary  active  constraints  which  will  be  replaced  by  (3.13). 
This  can  oe  done  by  using  the  vector  z  as  defined  by  (3.14).  If  z  <  0  , 
it  follows  from  Lemma  6  in  the  next  section  that  (2.1)  has  no  feasible  solu¬ 
tion  for  t  >  t-  .  If  z  has  at  least  one  positive  comnonent  let  the  set 

j 

I-,j  be  defined  such  that  i  €  I if  and  only  if 


iVi 

U)i 


min 


(z)„ 


(z)„  >  0 


and  sec 


m  n 


f  . 

r 


i  e  I 


3j 


It  is  not  difficult  to  verify  that  with  this  choice  of  1  the  nradients 
of  the  new  set  of  primary  active  constraints  are  linearly  independent  and  that 

there  are  ■  ■  0  such  that 


in 


-  (c  +  tj  q  -  C  Xj(tj))  = 


&  Vi  +  Vk 


Furthermore,  if  1^*0  it  follows  from  Lemma  7  that  the  above  rules  for 


choosing  k  and  1  ensure  the  existence  of  an  >  j  such  that  I ^ 


=  0  . 


Case  2: 


Either  Ijj  =  0  .  Iy  »  0  or  Iy  -  Iy  -  »  and  tJ+1  ■  tjfl  <  tJ+J  . 
In  either  case  the  constraint 

a]  x  <  (b)1  +  t(q)] 

has  to  be  deleted  from  the  set  of  primary  active  constraints.  If  C  is  not 
positive  definite  in  the  set 


x  a  I  x  =  0  ,  i  =  l . v  ,  i  *  1  j 


(3.15) 


or  if  there  are  secondary  active  constraints  at  x.(t.)  it  may  be  necessary 

J  J 

to  add  a  constraint 

a£  x  s  (b)k  +  t(q)k 

to  the  set  of  primary  active  constraints.  In  order  to  decide  this  we  denote 

the  1-th  column  of  M0.  by  s,  and  the  element  in  the  1-th  row  and  1-th 

‘-J 

column  of  M^-  by  to  .  Then  it  follows  from  Lemma  4  that  C  is  positive 
definite  in  the  set  (3.15)  if  and  only  if  to  <  0  .  Furthermore,  if  to  <  0  , 


xj(t)  =  c0(t_tj)si  =  hlj  +  (t "  lj)(h2j  "  Vl^  (3,16^ 


is  the  unique  optimal  solution  to  the  problem 

min  |  (c  +  tq)'x  +  ^  x'C  x  |  a  -  x  =  (b)^  +  t(p)i  ,  i  =  1 , . . . ,v  ,  i  *  1  j  , 

where  T  =  - - —  and  n~.  is  the  vector  used  in  (3.5).  If  there  are  second- 

o  to  Zj 

ary  active  constraints  at  x-(t-)  ,  (".15)  need  not  be  a  feasible  solution  to 

J  J 

(2.1)  for  any  t  >  t;  .  Therefore,  we  define  the  set 

J 

I4j-  =  {  i  |  a-  Sj  <  ^  and  a-  hj.  =  (b).  +  tJ.(p)i  1 


11 


and,  if  I^.  *  0  ,  the  number 


Tq  =  ™n 


lin  | 


<P>i  -  di  h2j 


»isl 


i  6  I 


4j 


.}• 


If  a  <  j  ,  then  (3.16)  will  be  a  feasible  solution  to  (2.1)  for  t  >  t, 

0  0  J 

sufficiently  smal 1 . 


Therefore,  if  u  <  0  and  o  <  t  no  new  primary  active  constraint  is 

oo 

needed.  If  uj  <  0  and  oQ  >  tq  ,  then  a  secondary  active  constraint  will 
become  a  primary  active  constraint.  Finally,  if  w  >  0  and  I^.  =  0  then 
the  problem 

min  j  (c  +  tq) '  x  +  -iy-  x1  C  x  al  x  =  (b)^  +  t(p^ )  ,  i  =  l, . . .  ,v  ,  i  *  1  } 

has  no  optimal  solution  for  t  >  tj  (see  the  proof  of  Lemma  6).  In  this  case 
either  (2.1)  has  no  optimal  solution  for  t  >  t-  or  there  is  some  x^  >  0 
and  some  index  k  such  that  s -^  <  0  , 

XjUj)  -  TjSj 

is  an  optimal  solution  to  (2.1)  and  a^Xj(tj)  -  T i  ak  s i  =  (b)|<  +  "t ^ ( p ) k  , 
where  and  k  are  determined  by  inserting  Xj(tj)  -  tSj  into  the 
i nequal i ties 

al  x  <  (b).  +  t(p)i  ,  i=v+l,, . . ,m 

which  are  not  active  at  Xj(tj)  and  computing  the  largest  value  of  x  for 
which  x j ( t j )  -  x  s^  is  feasible.  Details  of  this  procedure  are  given  in 
Step  3.3  of  the  algorithm  described  in  the  next  section. 


It  follows  from  Lemma  9  that  the  above  rules  for  changing  the  set  of 
primary  active  constraints  ensure  the  existence  of  an  >  j  such  that 
I lw  =  0  ,  v  =  j,  )+l,  ....  .jj  ,  and  I?u  =  0  . 


4.  An  algorithm  for  solving  parametric  linear  and  quadratic  programming 
problems 

In  this  section  we  describe  an  algorithm  for  computing  the  ootimal 
solution  to  problem  (2.1)  as  an  explicit  function  of  the  parameter  t  . 

It  is  assumed  that,  for  t  =  _t  ,  the  algorithm  starts  with  an  optimal  solu- 
tion  x  (t)  to  problem  (2.1)  which  has  the  properties  described  in  Lemma  2.1 


A  general  cycle  of  the  algorithm  consists  of  four  steps.  At  the  begin¬ 
ning  of  the  j-th  cycle  the  following  data  are  available: 


’  "2j  \ 

•  M4  J  ' 


hlj  •  h2j  '  qlj  •  g20  '  J(xj>  and  vj  • 


Here  v.  denotes  the  number  of  primary  active  constraints.  The  elements 

sJ 

a.,  of  the  index  set  J(x.)  are  positive  integers  and  are  defined  in  such  a 

J 

way  that  a •  .  =  k  if  and  only  if  the  i-th  column  of  the  matrix  Ai  is  equal 

I  J  J 

to  ak  ,  the  gradient  of  a  primary  active  constraint.  Then 

and 


-  c 


V 


b5 +  ‘j  “j 


,-i  I-  q\ 


where  bj  and  p^  are  appropriate  subvectors  of  b  and  p  ,  respectively. 


In  Step  1.1  and  Sten  1.2  the  critical  sets  1^  and  Kj  are  deter¬ 
mined  which  contain  the  indices  of  secondary  active  constraints  which  are  not 

satisfied  for  t  >  t-  and  multipliers  which  are  nenative  for  t  >  t ■  ,  re- 

J  J 

spectively.  If  both  sets  are  empty  Step  3.1  is  used  to  compute  the  maximal 

tj+j  >  tj  such  that 


*j(t)  •  hld  Mt-tph2j 
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is  an  optimal  solution  to  problem  (2.1)  for  t.  <  t  <  t-  ,  . 

In  Step  2  it  is  determined  whether  ak  ,  the  gradient  of  the  con¬ 
straint  that  becomes  a  new  primary  active  constraint,  is  linearly  dependent 
on  the  gradients  of  the  present  set  of  primary  active  constraints.  If  this 
is  the  case  then  a  constraint  is  selected  which  has  to  be  deleted  from  the 
set  of  primary  active  constraints. 


In  Step  3  a  constraint  a^  x  <  (b)^  +t(p)^  is  given  which  will  be 
dropped  from  the  set  of  primary  active  constraints.  If  the  problem 


mi  n 


(c  +  t  q) '  x 


x'C  x 


ai  x  =  (b). 


t(p)i 


i  t 


J(Xj) 


-  {1) 


has  a  unique  optimal  solution  which  satisfies  the  inequalities  Ax  <  b  +  tp 
for  t  >  t-+1  sufficiently  small,  then  no  new  primary  active  constraint  is 
required;  otherwise  a  constraint  is  determined  that  will  be  added  to  the  set 
of  primary  active  constraints. 


In  Steo  4,  the  matrices  +  \  and  M.^  are  computed. 

Next  we  give  a  detailed  description  of  a  general  cycle  of  the  algorithm. 


Step  1 


1.1 


Define  the  set  I^j  such  that  i  e  1^.  if  and  only  if 


(b)i  +  tj(p)i  -  al  hjj  =  0  and 
If  I|.  =  0  go  to  Steo  1.2;  otherwise  set 
k  =  min  {  i 


ai  h2j 


-  <P), 


>  0 


f  £llj}  ■ 


Vi s  h 


and  go  to  Step  2. 


1.2  Define  the  set  I,,  such  that  i  €  I9.  if  and  only  if 
( 1 T j ) i  =  0  and  (n2j)i  <  0  . 

If  I ^ j  =  0  go  to  Step  1.3;  otherwise  set 


1 


mi  n 


f 


\  -ii 

and  qo  to  Step  2.1. 


i  €  I, 


1 


i+l 


tj 
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1.3  If  ^2j  -  (p)^  <0  for  i=l,...,m  set  tj+^  -  tj  =  °°  ,  otherwise 


set 

t'tj  -  ts  =  min 


r  <b)j  *  tj(p),  -  a;  hy 


ai  h2j  -  <P>i  » 


ai  h2j  '  (p>i 

and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 
If  ^2 j  -  0  set  tj+j  -  t.  =  «>  ,  otherwise  set 

(Slj'i 


Vl  -  ‘j  -  m1" 


I  ‘*>1  < • } 


•f’a'i 


and  let  1  be  the  smallest  index  for  which  the  minimum  is  attained. 
Set 

Vi  ■  Vi} 

and  print 

‘j+l  •  hlj  and  h2j  • 

If  tj+1  >  t  stop;  otherwise  do  the  following.  If  tj+1  =  t*+1  go 
to  Step  2.  If  tj+1  =  tj+1  <  tj+j  go  to  Step  3.1. 


Step  2 


Compute 


»  =  M1;j  ak 


If  w  *  0  go  to  Step  4.1,  otherwise  compute 


2  '  'Vk 


If  z  <  0  stop  with  the  message  that  the  problem  (2.1)  has  no  feasible 
solution  for  t  >  tj+j  .  If  z  has  at  least  one  positive  component 
define  the  set  1^  such  that  i  e  1^  if  and  only  if 


(2), 


=  min 


f  IV; 
1  <*)„ 


<2>„  >  4 


Set 


=  min  (. . 
1  iJ 


i  e  I 


3j 


a 


and  ao  to  Sten  4.3. 
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and 


Step  3 

3.1  Set  sj  =  (M2j.)-,  ,  to  =  (M4j)n  , 

!4j  *  {  1  I  ai  S1  '  0  and  aihlj  *  <»>i  *  VP)i 

If  I^j  =  0  and  u  =  0  ,  go  to  Step  3.3. 

If  I^j  =  0  and  oj  *  0  ,  go  to  Step  4.2. 


If  I^j  *  0  ,  compute 


i0  =  mm 


1n{ 


(p)i  -  ai  h 


2j 


"  ai  S1 


i  G  I 


«,} 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained. 
If  tq  >  0  ,  go  to  Step  3.2;  otherwise  compute 

w  =  Mljak  . 

If  w  *  0  ,  go  to  Step  4.1;  otherwise  go  to  Step  4.3. 

(9?i) 


3.2  If  u)  *  0  and 


2i  n 

— —  <  xo  ,  go  to  Step  4.2;  otherwise  go  to  Step  4.3. 


U) 


3.3  Set 


!5j  =  j1  |aiSl  <0  and  aihlj  <  (b)i  +  Vp>i  t 


If  I =  0  ,  stop  with  the  message  that  there  is  no  optimal  solution 
for  t  >  tj+1  .  If  I5j.  *  0  ,  compute 


and  set 


Compute 


=  min 


(b)j  +  tjtp).  -  a;.hlj 


'  ai  S1 


i  e  lCi 


5j  | 


i  G  I5J 


(b)i  +  tj(p)i  -  a;hlj  1 

!  T7T  r  • 


-  mm 


(p)i  -  ai  h 


2j 


-  a’.  Sj 


aisl 


1  £  *6j 


and  let  k  be  the  smallest  index  for  which  the  minimum  is  attained.  Go 
to  Step  4.3. 
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Step  4 

4.1:  Set  v 


>1  =  V1  and  Vi 

Oi-’  ,  i  =1  »  . 


i»j+l  "i j 
Go  to  Step  4.4. 


:  {al,j+l . “vj+1,j+l} 

• »vi  »  %  i+i  =  k  • 


4.2:  Set  vj+1  -  Vj  -  1  and  Jj+1  =  (a1J+1.. 


a. 


=  a.  •  , 


i.j+1  ij 


i=l . 1-1 


ai,j+i  =  ai+l,j  ,  i=l,...,Vj-l  . 

Go  to  Step  4.4. 

4.3:  Set  vjtl  •  Vj  and  Jj+,  -  . , 

a  i  ,j+l  =  ‘‘ij  ’  1=1,'-*’vj  ’  1  *  1 

™l,j+l  =  k  ‘ 

Go  to  Step  4.4. 


4.4:  Set 


J  +  l 


^l,j  +  l’""a%j  +  1,j  +  l 


bd  +  l 


(b) 


(1J+1 


b ) 


Vj+l'j+1, 


•  +  1  r  l(P),  » - - • *(P) 

J  \  'l.j+1 


j+1 


,j+l 


c  -Aj.i 

Vl  .  0 


"l.jal  ’ 
M3,J+1  •  M4 


,  where 


,  where 


where 


,j  +  l  / 
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• c  -  Viq 


Ml,j+1  »  M2,j+1 


9 2 , j + 1  f  \3,j+l  '  M4, j+1  j  \bj+l  +  hj+lPj+l 


h2,j  +  l 


» M2j+r 


\92,j+l/  \  3,j+l  ’  M4J+1/  \Pj+l/ 

Replace  j  with  j+1  and  go  to  Step  1.1. 


In  the  following  we  prove  some  lemmas  which  establish  the  basic  prop¬ 
erties  of  the  algorithm.  The  first  two  lemmas  are  concerned  with  the  exist¬ 
ence  of  M.  *  . 


Lemma  4 


Let  Sj  =  (Mg j ) i  and  oj  =  (M^.)^  be  defined  as  in  Step  3.1  of  the 


Proof: 


algorithm  and 

assume 

that 

x'Cx  >  0 

for 

x  *  0  , 

xc{: 

x  |  al  x  =  0  ,  i 

i) 

Then 

x'Cx  > 

0  for 

x  *  0  , 

xeT  = 

|  x  al  x  =  0  , 

ieJj  - 

if  and  only  if 

■.o  <  0 

• 

ii) 

If  .  < 

0  set 

’o  ■  1 

1  -  2j )  1  U 

.  Then 

Xj(t) 

-  a  it  - 
ov 

Vi,si 

is  the  unique 

optimal 

solution 

to  the  problem 

min  |  (c 

+  to) '  ) 

<  +  ix'( 

I  x  a !  x 

=  (b)i  +  t(p).  , 

■  1€Jj 

Set 

s2  = 

i*l  - 

Then 

c s  1 

+  41  S 
1 

9  =  0, 

a;.  Si  = 

0  ,  i  e  - 

n ' 

al  S1  = 

1  . 
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Thus 

S1 C  Sj  =  -  Aj  s2  =  -  (s2)1 

Let  x  £  T  and  x  *  0  .  Then  there  are  A  and  y  such  that  A ^  y  =  0 
and  x  =  y  +  Xs^  .  Therefore, 

x'  Cx  =  y*  Cy  +  2  X  s^  Cy  +  X2  s^  C  Sj  (4.3) 

=  y‘  Cy  +  A2s^Cs1  , 

because  s^Cy  =  -  s£A^y  -  0  .  Since  Sj  £  T  ,  the  first  part  of  the  lemma 
follows  from  (4.2)  and  (4.3). 

In  order  to  prove  the  second  part  of  the  lemma  we  first  observe  that 

aj  (Xj(t)  -  aQ( t  -  tJ.+i)s1)  =  (b).  +  t(p)i  ,  i€Jj  -  {1}  . 

Furthermore, 

Cx.(t)  +  A'.v.(t)  =  -(c  +  tq)  (4.4) 

J  J  J 

with  (Vj(tj+1))1  =  0  .  Thus 

C  [ x  j  ( t )  -  -0(t- tJ+1)Sj]  +  AjtVj(t)  +  o0(t-tj+1)s2)  =  -  (c  +  tq)  (4.5) 
and 

(Vj(t)  +  q0(t-tj+i)s2),  =  (»j(tj+i)),  +  [‘-ViKSyto^j), 

■  It_  tj+l,(l92j*l  *  aol'Szh'1  °  0  • 

Therefore,  it  follows  from  (4.4),  (4.5)  and  the  Kuhn-Tucker-conditions  that 
xj(t)  -  :o(t-tj+j)Sj  is  an  optimal  solution  to  (4.1).  By  the  first  part  of 
the  lemma  it  is  the  unique  optimal  solution. 

lemma  5 

If  M  is  a  nonsingular  matrix,  then  every  matrix 


determined  by  thci  algorithm  is  nonsingular. 
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Proof: 

Suppose  that,  for  some  j  ,  M.  is  nonsingular.  Because  of  Lemma  2  we 

J 

know  that  then  the  columns  of  A',  are  linearly  independent  and  x'Cx  >  0 
for  every  x  *  0  with 

xeTj  =  Hv  =  °}  • 

Similarly,  it  follows  from  Lemma  2  that  is  nonsingular  if  the  columns 

of  are  linearly  independent  and  x'Cx  >  0  for  every  x  *  0  with 

x  e  Vi  •  H  Vix  ■  °}  • 

Without  loss  of  generality  we  may  assume  that 


Aj  =  (a1,...,av)  . 

First  assume  that  Step  2  of  the  algorithm  is  used  in  the  j-th  cycle.  Then 


Mlj  •  "2j 
H3j  • 


Mlj  ak 
M3j  \ 


c"  +  "j  z  ■  »k  • 

If  w  *  0  ,  then  Aj+1  =  (ai»-  •  •  »av‘a|<)  • 

If  w  =  0  ,  then  A^+1  =  (a^ . . .  »a1.1,ak,a1+1,. . .  .aj  with  (z)1  *  0  . 

In  both  cases  it  follows  immediately  that  the  columns  of  A'.+^  are  linearly 
independent.  Furthermore,  x'  C  x  >  0  for  every  x  *  0  with  x  e  Tj+^ 
because  Tj+^  c  Tj  . 


Next  assume  that  Step  3  of  the  algorithm  is  used  in  the  j-th  cycle.  If 


Aj+1  =  (a1,...,a1_1,a1+1,...,aj 

then  ^  *  0  .  The  columns  of  Aj+^  are  linearly  independent  and  it  follows 
fnon  Lemma  4  that  x'  C  x  >  0  for  x  *  0  ,  x  e  Tj+^  .  If 

Aj+1  =  (ai»*  *  •  »ai_l»ak’al  +  l*" ' '  ,a  .‘) 

then  a£.  s^  <0  . 
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Since  a^  s^  =  0  ,  i=l,...,v  ,  i  *  1  ,  the  columns  of  Ai  +  ^  are  linearly 

independent.  Furthermore, 

x  e  Tj  =  {x|aix  =  0  .  i=l . v  *  i  *  A 

and  x1  C  x  =  0  imply  x  =  \  s^  for  some  X  .  Since  Tj+j  =  T.  n  { x > a ^ x  =  0 > 
and  ak  <0  the  vector  Sj  is  not  an  element  of  T.+^  .  Thus  x  6  Tj+1 
and  x  *  0  imply  x'  C  x  >  0  . 


The  next  lemma  shows  that  the  termination  of  the  algorithm  with  Step  2 
or  3  implies  that  tie  given  problem  has  no  optimal  solution  for  t  >  t-+^  . 


Lemma  6 


i)  If  the  algorithm  terminates  with  Step  2  in  the  j-th  cycle,  then 
the  problem  (2.1)  has  no  feasible  solution  for  any  t  >  t.+j  . 

ii)  If  the  algorithm  terminates  with  SteD  3  in  the  j-th  cycle,  then 
the  problem  (2.1)  has  no  optimal  solution  for  any  t  >  tj  +  1  . 


Proof: 


i)  We  have  a k  =  Aj  z  ,  z  <  0  and,  by  the  definition  of  k  , 

ak  hlj  ■  <b>k  *  Vl(p,k  '  ak  h2j  >  <b>k  ' 

Let  t  >  t  -  ,  and  A  .  x  <  b.  +  t-  p.  +  ( t  -  t j  )  p  .  .  Then 

J  '  ^  vj  J  J  J  J  J 


and 


Therefore, 


Aj(x-hU-(t-'j>h2j)  s  0 


ak(hlj  '  (t  "  ti)  h?i)  >  (b)|,  +  t,*  (P)fc.  +  (t-t1.)(p)t  . 


T  2j 


k  '  '"j  VK'k 


j  ' '  ;k 


akx  =  a k ( h i -  (b‘  tj)h2j)  +  z'Aj(x'  hlj  ‘  (t_tj)h2j) 

>  (b)k  "  tj(p)k  +  (t-tj)(p)k  . 


ii)  Without  loss  of  generality  we  may  assume  that  A1 
By  the  definition  of  1  we  have 

( v j ( T j+i ) ) i  =  0  and  (q2j)1  <  0  . 


(a^,. . . ,aM)  and  1  = 


°1 


Furthermore,  let  and  sQ  be  defined  as  in  the  proof  of  Lemma  4.  Then 


’l^bl 


Because  C  is  positive  semidefinite  this  implies  C  s^  =  0  .  Thus  for  any 


t  >  tj+2  »  we  ^ave 


S  i  C  xj  ( t )  +  s  ^  Aj  v  j  ( t )  =  -  s^(c  +  tq) 


-  s^(c  +  t  q)  =  (Vj(t})1  =  +  (t- tj  +  i)(q2j)l  <0  • 

Furthermore,  since  1^  =  0  and  I^j  =0  it  follows  that  a!  s1  >  0  for 
i=l,...,m  .  Therefore,  if  for  any  t  >  tj+^  ,  there  is  a  feasible  solution 
x  ,  say,  then 

a !  ( x  -  a  s ^ )  <  ( b ) .  -?■  t  ( p )  •  for  a  11  o  >  0 
and  i=l,...,m  .  Moreover, 

(c  +  t  q)'  (x  -  i  Sj)  +  ^  (x  -  o  Sj)'  C(x  -  a  Sj)  = 

~  >\  1  /N  A 

(c  +  tq)'  x  +  y  x'  Cx  -  o(c  +  tq)'s^-*--“  as  a-*-00 


The  main  difficulty  in  showing  the  finite  termination  of  the  algorithm 
is  to  prove  that  for  every  j  for  which  the  union  of  the  critical  sets  Ij. 
and  Ip.  is  not  the  empty  set  there  is  some  .j ^  >  0  such  that  1^  U  Ipj  =0 
This  is  done  in  the  following  three  lemmas.  ‘  1 


Lemma  7 


For  every  jQ  with  1^  +0  there  is  jj  >  jQ  with  =  0 

Proof: 

* 

There  is  a  largest  integer  j  >  .j  with 

!lj  *  0  ’  j=jo’J'o+1 . j 


ak  $  span  -j  j  i  e  J(  Xj*)  j.  , 

(here  k  is  the  index  determined  in  Step  1.1  of  the  algorithm.  Set  j  =  j*  +  1 
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and  let  D  be  any  matrix  such  that  (A!-  ,D')  is  a  nonsingular  (n,n)-matrix 

J 

and  every  column  of  O'  is  orthogonal  to  all  columns  of  A!,  .  Define  the 

J 

set  of  integers  1  in  such  a  way  that  i  €  I  if  and  only  if 

a;  Xj ( t j )  =  (b).  +  tj(p)i  (4.6) 

and 

a.  e  span  j  ai  |  1  e  J(Xj)  }  .  (4.7) 

Finally  choose  any  t  >  tj  and  consider  the  following  linear  programming 
problem 

max  |(bj  +  tPj)'  v  +  ^  ((b)i  +  t  (p). )  X.  j 

subject  to  the  constraints 

Aj  v  +  Dy  +  a.  Xi  =  -  (c  +  tj  q)  -  C  Xj(tj) 

v  >  0  ,  X.  >  0  ,  i  €  I  . 

We  will  apply  the  simplex  method  with  Bland's  [1]  minimum  index  rule  to 
this  problem. 


First  we  observe  that  (Aj  ,  D)  is  a  basis  matrix  for  this  problem.  The 
corresponding  basic  solution  is  v  =  v.(t-)  ,  y  =  0  .  In  order  to  determine 

J  J 

the  new  basic  variable  we  compute 


x 


:bj 


+  t  O; 


and 

^  =  (b)i  +  t(p)i  -  al  x  ,  i  €  I  . 


If  >  0  for  all  i  €  I  ,  then  the  current  basic  solution  is  optimal.  If 
at  least  one  <•  is  negative,  then  will  become  the  new  basic  variable, 
where 


r 

k  =  min  <j  i  €  I 


(4.8) 


Because  x  and 
we  have  A  .  ( x  -  x - ( t ) ) 

J 


x  - ( t )  are  solutions  to  t^0  equations  A  .  x  =  b  .  +  t  P •  , 
l  J  J  j 

=  .  Th jS  it  follows  from  (4.7)  that 
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(4.9) 


Since 


xj(‘> 


=  h 


lj  + 


ai  h2j 


(b)i  +  t(p)i  -  ai  Xj ( t)  ,  i  €  I  . 

(t-tjOhjj  we  deduce  from  (4.6)  and  (4.9)  that 
-  (p)..  >0  for  every  i  €  I  with  <0  . 


Therefore,  every  i  €  I  with  a.  <  0  is  an  element  of  the  set  1-,.=  .  Since 

★  '  ~ 
by  the  definition  of  j  ,  the  index  k  determined  in  Step  1.1  of  the 

algorithm  is  an  element  of  the  set  I  ,  it  is  identical  with  the  k  selected 

by  (4.8). 


In  order  to  determine  the  basic  variable  that  will  leave  the  basis  we 
compute 

/ 

I  =  U.. 

J 


=  (Ai  ,  D'f1  ak  . 


From  (4.7)  we  deduce  that  =  0  and  =  ?■  ,  where  z  =  ak  is  the 
vector  determined  in  Step  2.1  of  the  algorithm  as  part  of  the  solution  to  the 
equations 

a, 


C  w  +  A1,  z 

J 

A .  w 

J 


‘k 
0  . 


Defining  the  set  I  such  that  i  €  I  if  and  only  if 


(z)i 


min  \  ^ 1 


<Z>v 


z  >0 


we  obtain  the  index  of  the  basic  variable  that  will  leave  the  basis  as  follows 

1  =  min  |  a.j j  i  €  I  |  . 

This  index  is  the  same  as  the  one  determined  in  Step  2  of  the  algorithm. 


The  above  results  show  that,  for  j  =  j*  +  1  ,  1^.  =  0  if  and  only  if 
v  =  vj(tj)  *  Y  =  0  is  an  optimal  basic  solution  to  a  linear  maximization 
problem.  If  1^  *  0  ,  then  (Aj  +  j  ,  D' )  is  the  basis  matrix  obtained  by 
performing  one  iteration  in  the  simplex  method.  The  corresponding  basic 
solution  is  optimal  if  and  only  if  ^+1  =  0  .  Repeating  this  argument  and 
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observing  that  by  Bland's  rule  the  simplex  methods  determines  on  optimal 

solution  in  a  finite  number  of  iterations  we  deduce  that  there  is  >  jQ 

with  1 1 .  =  0  . 

iJl 


Lemma  8 


For  every  j  ,  1^-  =  0  and  1 2 j  *  0  imply  Ijj+1  =  0  . 


Proof: 


Let  Sj  =  (M2-)1  and  s2  =  (M^  .  Then  (Sj  ,  $2)  satisfies  the  equations 


'2jM  a"u  "2  "  4j 

C  S1  +  Aj  s2  =  0 

A,  s1  =  e.  , 

J  1  J 

where  (e.)^  =  0  ,  i  #  1  ,  and  ( e ^ )  -j  =  1  . 

Furthermore, 

Xj(t)  =hu  *  (t-tjjhy  ,  Vj(t)  •  9lj  *  (t-tj)9y 
are  determined  as  the  unique  solution  to  the  equations 

C  x  +  Al  v  =  -(c  +  tq) 

J 


(4.10) 


x 


=  bj  +  t  Pj 


Without  loss  of  generality  we  can  assume  that 

and  1  -  v 


Ai 


Then 


vj  +  l<t>  ”  «l,j+l  *  (b-bjtllOj.j  +  i 
is  the  unique  solution  to  the  equations 


C*  +  AJ+1v  ■ 
Aj  +  1* 


-  (c  +  tq) 

Vi + 1  pj+i 


(A. 11) 


where  AJ+1  =  (aj,.. .,a0.j)  or  Aj+1  =  (a2 , . .  .a,, ,ak )  or  Aj  +  1  =  (alt. . .av_j,ak)  , 

denendinq  on  which  part  of  Step  3  of  the  alqorithm  applies.  Because  I+>j  *  0  we 

have  t.  ,  =  t •  . 

;  +  i  J 


25  - 


Case  1: 


I4j  *  0  and  tq  =  0  . 


Since  aj,  h^.  -  (p)k  =  0  ,  it  follows  that 


ak  x j ( t )  =  (b)k  +  t(p)k  +  (t-  tj)(p)k 


(4.12) 


for  all  t  . 

If  Mlj  ak  *  0  »  then  Aj+l  =  (Aj  »  ak)  and  fol1ows  from  (4- 12)  that 

Xj(t)  ,  (Vj(t)  ,  0) 

is  a  solution  to  (4.11).  Thus  x-+^(t)  =  Xj(t)  .  If  i  is  the  index  of  a 
secondary  active  constraint,  we  have,  therefore, 


i  .e.  I 


l.j+l 


Then 


ai  h2.j*l 

-  (P)i  = 

ai  h2j 

-  (P). 

IA 

O 

V 

that  . 

ak  =  °  . 

Then 

Ak  - 

(ap. . .  »av.1»ak 

)  and 

z  s  "2j  al 

k  .  Since 

<z>, 

"  Z'AJ 

S1  =  ak  S1  *  0  ’ 

w'e  can 

def i ne 

( 9 1  j )  i 

( gl j  )  i 

(sio ' i 
(z)i 

(Z)i  . 

i = 1 » . . . .v-1 

<9lj>l  * 

( 9 1  j )  1 
(2)1 

(o2J)i  * 

(g2j)i  - 

(92j^l 

(Z), 

(z)i  , 

i  =  l . v-1 

<  ®2j  > 1  ' 

(g2jh 

<z), 

V‘>  ■  a; 

vj(t)  • 

V‘>  . 

:  hi + 

(Z-tjlOy  . 

(4. 

.13) 

Therefore,  it  follows  from  (4.12)  and  (4.13)  that  Xj(t)  ,  Vj(t)  is  a  solu¬ 
tion  to  (4. 11).  Thus 


-  - 


xj+1(t)  =  X.(t)  (4.14) 

and  h.j+i  =  0  • 

Case  2: 

(1^^  =  0  and  co  *  0)  or  (1^  *  0  ,  t0  >  0  ,  co  *  0  ,  and 
( g2j ) i  /  w  <  t)  . 

In  this  case  we  have  Aj+1  =  (a1,...,av_1)  .  With 

( 92 i ) 1 

ao  =  *  w  =  (M4pll  =  (s2^1 

co 

we  have 

(Vj(t))i  -  a0(t- tJ-)(s2)1  =  (t- tj)((g2J)1  -  o0(s2)1)  =  0. 

Let  Vj(t)  and  s2  denote  the  vectors  obtained  from  Vj(t)  and  S2  . 
respectively,  by  deleting  the  1-th  component.  Then 

*j(t)  -  a0(t- tj)Sj  .  Vj(t)  -  ff0(t-tj)s2 

satisfy  the  equations  (4.11).  Indeed, 

Vi  xj<t>  -  °o^ '  si 5  Vixd(t) '  bj+i +  tpj»i 

and 

C  (  Xj(t)  -  oQ(t-  tjJSj  ]  +  AJ+1  [  Vj(t)  -  oQ(t-  tj)  s2  )  = 

C  Xj(t)  +  ( t  -  t j ) A i  s 2  +  AJ  [  Vj(t)  -  a0(t-tj)  s2] 

C  +  Aj  vj^  =  ’  (c  +  tq)  . 

By  Lemma  4  we  have,  therefore,  Xj+^(t)  =  x^(t)  -  -!o ( t  -  t ^ )  s ^  which  implies 

hl.J,l  -  hlj  and  h2,j*l  =  h2j  ‘  %S1  '  <4-15> 

Furthermore,  (^j^l  <  0  and 

to  =  (Sp)}  =  *>[  Aj  s2  =  -sjCs,  <0  (4.16) 

imply  "0  =  ( 92j ) i  /  ■  >  n  • 
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Now  let  i  be  the  index  of  any  secondary  active  constraint.  If 
ai  Sj  >  0  ,  then 

ai  h2,j+l  '  (p,i  ’  ai  h2j  '  (p)i  ‘  °o  ai  S1 

<  ai  h2j.  -  (p)^  <  0  . 

If  a".  Sj  <  0  ,  then  i  €  I4j  and 

ai  h2,j+l  -  <P>1  3  ai  h2j  -  <p>i  -  °0  ai  S1 

.  f<ph  -  ai  h«  .  \ 

*  ai  M  °°) 


£  ai  S1  <To  ■  ao>  «  0  • 


Therefore,  1^  -+j  =  0 


Case  3: 

(I4j  *  0  ,  t0  >  0  ,  a)  =  0)  or  (I4j  *  0  ,  >  0  ,  w  *  0  ,  and 

(g2j)l  /  a)  >  tq)  . 

In  this  case  Ai+1  =  .  With  the  same  arguments  as  in 

the  previous  section  it  can  be  shown  that  Xj+j(t)  =  xj(t)  ”  To^t_tj^sl  ’  i-< 

hl,J+l  ■  hlj  and  h2,j*l  ‘  h2j  -  To  S1  •  (4'17) 

Let  i  be  the  index  of  a  secondary  active  constraint.  If  ai  s1  >  0  ,  then 

ai  h2,j+l  -  <p>i  =  ai  h2j  '  (P,i  '  To  ai  51 

<  ai  h2j  -  (p)i  <  0  . 

If  ai  Sj  <  0  ,  then  i  €  I4j  and 

ai  h2 , j+1  "  (p)i  =  3i  h?3  ‘  (p)i  '  7o  ai  S1 

_  a.s  <0. 

-  -ais,  °)  - 

Hence,  I1>j+1=0- 
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Case  4: 


I4.  =  0  and  to  =  0  .  In  this  case  Step  3.3  of  the  algorithm  applies 
an 

Aj+1  =  (al’‘"»av-rak)  • 

Because  oj  =  0  the  equality  (4.16)  implies  s^Cs^  =  0  which,  for  the  positive 
semidefinite  matrix  C  ,  is  equivalent  to  Cs^  =  0  .  Thus 

C  Xj(tj)  =  C  [  Xj(tj)  -  Tj  Sj  ]  . 

Furthermore,  by  the  definition  of  in  Step  3.3  of  the  algorithm 

aic(xj<t)  '  T1  sl>  ■  (b)k  +  • 

Therefore,  it  is  not  difficult  to  show  that 

Vl(t>  '  *j(‘)  -  T1  S1  -  <*- tj)  T2  S1 

Vl(t)  '  vo(t>  •  (‘-‘j)  t2  s2 

is  a  solution  to  (4.11).  Hence  we  have 


hl,j+l  =  hlj  '  T1  S1  ’  h2, j+1  =  h2j  "  T2  S1  • 


(4.18) 


Let  i  be  the  index  of  a  secondary  active  constraint  for  Xj+i^j+i)  . 

If  this  constraint  is  also  a  secondary  active  constraint  for  x. (t. )  ,  then 
=  xj(tj)  -  s^  with  r1  >  0  .  Thus  t^+1  =  t-  implies 


a s  1  =  0  ,  i .  e . 


ai  b2,j+l  -  <">1  =  ai  h2j  -  (P>1 


If  the  i-th  constraint  is  not  a  secondary  active  constraint  for  x-(t-)  , 

J  J 


then  i  e  Ig.  and 


aS  h2,j*l  -  (p)j  ■  ai  h2j  -  (P>i  -  2  ai  S1 
.  ..  ,  ((p,i  • a;  hy  . 


ai  S1 
<  0  . 


-  a •  Si 
1  1 


Therefore,  I,  .  .  =  0 

1  *  J  +  1 
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Lemma  9 


For  every  jQ  with  1^-  =  0  and  I gj  *  0  there  is  j1  >  jQ  such 
that  0  0 

hi  =  0  ’ 

J2j  *  0  >  j=j0»J0+l . Jj-1.  I2j  =  0  • 

Proof: 

If  Ij.  =  0  and  I Pj  *  0  then  Step  1.2  and  Step  3  of  the  algorithm  are  used 
to  determine  the  matrix  and  Mj+^  .  With  tj+j  =  tj  and 

xj+l(t)  =  hl,j+l  +  tj+l)  h2,j+l 

it  follows  from  formulas  (4.18),  (4.17),  (4.15),  and  (4.14),  respectively,  in 
the  proof  of  Lemma  8  that 


hl,j+l 

=  hlj  - 

T1  S1  ’  h2, j+1  =  h2j  '  T2  S1  ’  Tl  >  0 

(4.19) 

hl.j+l 

=  hlj  1 

h2, j  +  1  =  h2j  "  0  si  »  0  =  to}>  0 

(4.20) 

hl,j+l 

=  hlj  ’ 

h2, j+1  =  h2j  • 

(4.21) 

Each  vector 

(h^.,  hg. 

■)  is  uniquely  determined  by  a  submatrix  A, 

J  J 

of  A  . 

Thus  there  are  only  finitely  many  different  vectors  h^)  • 

First  assume  that  (h^  j+j,  h 2  j+j)  is  given  by  (4.19).  In  this  case 
s^CSj  =  0  and,  therefore,  Cs^  =  0  .  Hence  it  follows  from 

•si(cttj<i)  *  siCxi<tj> +  siAjvj<tj)  -  =  <9ij)i  =  0 

and  the  equalities 

C’lj  ’  (t-tjlfy  *  Vlj  *  <t'tj)#j92.r'(c*tJq)  ‘  (t‘tj,q  <*•“> 

that 

-  q'sl  '  q2j  Aj  S1  '  q2j  •  (c2j),  <  0  . 

Therefore,  we  have 

<’'hi.j+i  *  q'hij  -  i  n'H  K  ‘>'hij  • 
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This  implies  that  (h1>j+1  »  h2,j+i)  is  determined  by  (4.19)  for  at  most 
finitely  many  j  . 


Next  suppose  that  h2  .+1  is  given  by  formula  (4.20).  Then  s} C Sj  >  0 
and  it  follows  from  (4.22)  that 


q' si  "  h2j  C  Sj  -  92 j  AjSl  =  (gy),  <  0  . 


With  Q(h2j)  =  q'h2j  +7h2jCh2j  we  have’  therefore» 


Q( ^2 , j+1 ^  =  Q(h2j)  "  a(q'sl  +  h2j^  sl^  +  IT  S1  ^ S1 

2 

=  Q(h2j)  +  a(g2j)-j  +  ~2~  S1C'S1  • 


Because  ( 92j ) 1  <  0  ,  we  have 

a2  (g2j)l 

o(g2j )-|  +  si  CSj  <  0  for  0  <  a  <  J 


si  Cs 


rn 


By  (4.16)  ,  -  s(LCs1  =  oj  .  Furthermore, 

n-n{^l.U>0 


o  =  mi  n 


co 


Thus  Q(h2  j+1)  <  Q(h2j)  .  In  conjunction  with  the  previous  results  this  implies 


that  h9  .  -I  is  determined  by  (4.20)  for  at  most  finitely  many  j  . 

c ,  j+i 


In  order  to  complete  the  proof  of  the  lemma  it  suffices,  therefore,  to  show  that 
for  at  most  finitely  many  consecutive  indices  j  we  have 


'2,  j+1 


h2j  ‘ 


(4.23) 


It  follows  immediately  from  Step  3.1  and  Step  4.1  that  for  every  j  with 


h2  =  h2j  ,  there  is  a  largest  integer  j  such  that 


h2, j+1  =  h2j  » 


and 


ak  €  span  |  ai  i  €  J  (x^)  j 
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where  k  is  the  index  determined  in  Step  1.1  of  the  algorithm.  Define  the 
set  I  of  integers  in  such  a  way  that  i  e  I  if  and  only  if 


and 


Furthermore,  define 


ai  xj(t3)  =  (b)i  +  t3(p)i 

a.  £  span  j  a^  i  £  J ( ) 


/ 


Set 


I  =  <  i  |  i  €  J(xj)  ,  (g^  =  0  with 


d  =  q  +  C  h^ 


=  i 


and  consider  the  minimization  problem 
a-  h  =  (p)i  , 


i  6  J(Xj)  -  I 


min  \  d'h  I  '  J '  A  1 

h  *■  a’,  h  +  X.  =  (p)i  ,  X.  >  0  ,  i  £  I  u  I  ' 


(4.24) 


We  apply  the  simplex-method  with  Bland's  [1]  minimum  index  rule  to  this 
problem.  An  initial  basic  feasible  solution  is  given  by 


h  =  h23  , 

Xi  =  0  , 

let 

A 

s 

V 

be  such 

that 

ai 

A 

s 

V 

=  o  , 

i  €  J(xj) 

a' 

A 

s 

=  1  . 

V 

V 

2j  '  A 

S 

V 

into  the  objective 

basic 

variable  if 

-  d' 

s 

V 

=  '  (q* 

+  hJ,o  C)  s 
2j  '  v 

(4.25) 


A 

Replacing  j  with  j  in  (4.22)  and  using  (4.25)  we  obtain 
-  W  *  C)  2v  .  (nj3)v  . 

This  implies  that  X-j  will  become  a  basic  variable,  where  1  is  the  same  index 
as  the  one  determined  in  Step  1.2  of  the  algorithm.  Thus  s-|  =  s^  as  defined  by 
Step  3.1  of  the  algorithm. 
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A  basic  variable  Xi  is  a  candidate  for  becoming  a  nonbasic  variable  if 
-  a^  Sj  >  0  .  If,  for  all  i  €  I  , 

-  ai  s^  <  0  or  X.  >  0 

then  the  new  basic  solution  is  different  from  h^  .  If,  for  some  i  €  I  , 


a;  Sj  >  0 


and 


X.  =  0 

l 


then  i  €  I 


4j 


and 


Xk  will  become  a  nonbasic  variable,  where  k 


is  the 


index  determined  in  3.1  of  the  algorithm 


Thus  every  iteration  of  the  algorithm  such  that  j  >  j  +1  and  h,  j  +  j  =  h^j 
is  equivalent  with  an  iteration  of  the  simplex  method  applied  to  (4.24).  By 
Bland's  rule  this  implies  that  there  are  at  most  finitely  many  consecutive  j 
such  that  (4.23)  holds. 


Using  the  above  results  we  can  now  establish  the  main  theorem. 


Theorem 


The  algorithm  determines  a  finite  number  of  parameter  values  t  ,tj . t 

and  vectors  h,.  ,  h0.  ,  j=0, 1, . . . ,v-l  ,  such  that 

■LJ  J 


i) 

ii) 

i  i  i ) 


For  j  =0 , 1 , . . . ,v- 1  , 

x  . ( t)  =  h^  +  ( t  -  t j ) h ^ j  is  an  optimal  solution  to  the  problem 
(2.1)  for  all  t  with  t-  <  t  <  t-+l  . 

Either  t  >  t  or  (2.1)  has  no  optimal  solution  for  any  t  >  t  ,  . 


Proof: 

It  follows  from  Lemma  7  through  9  that,  for  every  j  ,  with  tj  =  tj  +  j  ,  there 
is  some  >  j  such  that 

b  =  Vi =  *  U,  ‘  U, * 1  •  (4-M) 

Furthermore,  for  every  j  , 

X.(t)  =  b,f  *  (t-tphjj 
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is  uniquely  determined  by  the  matrix  Aj  whose  columns  are  the  gradients 
of  the  primary  active  constraints.  Since  by  the  definition  of  tj+^  the 
vector  Xj ( t)  is  not  an  optimal  solution  to  (2.1)  for  any  t  >  t.+j  it 
follows  from  (4.26)  and  the  fact  that  there  are  only  finitely  many  different 
submatrices  A',  of  A1  that  the  algorithm  terminates  with  some  t  .  If 
t  <  t  ,  termination  occurs  either  with  Step  2  or  with  Step  3  of  the 
algorithm  in  which  case  Lemma  6  asserts  that  the  given  problem  has  no  optimal 

solution  for  any  t  >  t  . 
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